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I. RELATED EQUATIONS 


The objective function is 

















Gr (sn; 24) = 
min Gp(a@n, $n} 2n) = Fn (æn; zn) + PEG i 41 (Sn41; 2n+1)] 
s.t. TŻ = eT," + (1-6) ae + Ter)» (1a) 
TAT ST, (1b) 
0<en <@, (Ic) 
0 < Ad, < Adr, (1d) 
Ph, Ph> 0 
En = Ente l (le) 
7Ph> Ph LO 
0< Enry <E, (if) 
1 
NPr < P, —— Ph < P. (1g) 
n2 
0 < Adn < Adh, (1h) 
Th = dn — Adn + en + Ph — Ih — Th, (11) 
Th S Th S Th, dj) 


We simplify (1) by replacing the expected future cost 
Gi}ņ1(Shi Zn) by another term Hy, ,(Sp;Zn), so that the 
problem becomes 


Gi (8h; Zn) = 
min Gn(#p,8n3 Zn) = Fr(tn3 zn) + B 
Th 


s.t. (1a) — (Lj). 














"(Hh 41($n413 Zn41)] 


(2) 
In particular, H% 41 differs from G% +1 in the sense that the 
constraint (1j) is omitted: 


Hipi l(Sh+1; Zh+1) = 














min F;,(®n41; Zn41) + BE[H), 4 0($n+23 Zn+2)] (3) 
Lh. 
s.t. (1a) — (1).! 
APPENDIX A 


PROOF OF LEMMA 1 


Proof. To prove that H} (sn; zn) is convex in sp, we will show 
that for any s} = {T}™", E}} and s? = {T}? E2}, 


AH) (8p; Zn) + (1 — aH} (Shi zn) > Ha(sns2n), 4) 


where a € [0,1] and s3 = {aT*”' + (1—a)Tj"” a EL + 


(1 — a) Ek}. 
Let [$], 2} 1 l 2}, 2741,- --] denote the sequence of 
} and sĉ?, respectively. 


decisions following from the states s}, 


!The subscripts in (1a)-(1i) are changed to h + 1. 


Following the state s}, a heuristic way Theu is to produce a 
decision as a convex combination of ĉ} and ĉ?. 


Theu($}, Zn) = ak} + (1 — a)ê?, Yh. (5) 


As all constraints in Problem (3) are convex, the heuristic way 
Theu 1S feasible for Problem (3). According to the definition 
of optimality, the heuristic way achieves no less operating cost 
than the optimal function 79, ie., 


Oy Ries Ses 2a) S Hy, (Bes eA) (6) 


As objective function in Problem (3) is convex in a, the 
operating cost adopting Theu satisfies: 


On (Treu: Sh, Zh) < AHY (sh; zn) + (1 — aH} (s3; zn). 


Combining (6) and (7), we verified Equation (4) and thus 
proved Hž (Sn; Zh) of Problem (3) is convex in sp. 














APPENDIX B 
PROOF OF LEMMA 2 


Proof. For clarity, we use Gr(an) to denote Gr(&h, 8h; Zh). 
To prove that Problem (2) is convex in xp, we will show that 
for any feasible x}, and x7, x} = aw, + (1 —a)x? is also 
feasible and satisfies 
aGn (ap) + (1 — a)r (27) > Gna), (8) 

where a € [0, 1]. 

Let s;,,,, 85,1, and s?, denote the system states at time 
h-+1 following the decisions of x}, æ}, and a}, respectively. 
When the decision is æ}, the value of Ga (æ?) is 














Gr (ah) = Fa læ}; cn) + BE[Hi 41 (shy1iznti)], ©) 
Since Fn (£h; Zh) is convex in £h, we have 


Fp (£3; Ch) CAFp (£h; Ch) + (1 +a) Fn (£2; Ch). (10) 


Moreover, according to Equations (la) and (le), we have 
Shay > aslı +(1- ot) 87.44. According to Lemma 1, we 


have 
Hrs (Si.413 Zn+1) 
SH 1 (08,41 + (1 — @) 85.445 Zn41) 


SOW 1 (8h415 Zn41) + (1 — a) (Sh415 Zn41) 


(1) 





Combining (9)-(11), we verified Equation (8) and thus 
proved G,(a),) is convex in xp. 














APPENDIX C 
PROOF OF PROPOSITION 1 


Proof. 


Ach, 


Hy, (Tse, Te) = ae 


le Tan 4. +(1- e)Te“*)+ 














Ac Ch * in OU 
oo nao Thai + BEH (Thi Chen Thea )] 
s.t. T7", > max([T, eT” + (1 — e)TR“*], 





+i oar + + Te). 

(12) 
Let M(T}", cn, T?") denote the optimal value of the mini- 
mization problem in (12), that is 


M(T}” , cn, TR") = 


T}? < min[T, eT}? + 

















Ach in SA pk ive ou 
Tpi n(l —6) Try + BE[H 41 (Trai cht, Trfa)] (13) 
st maxl,eD} +(1— TRY] < Tit <T. 
When T > TẸ + (1 = eTR", ies TR < 
E, M(T}”, cn, T8”*) is independent of T}". Hence, 


OELH; (TR Cn TR“*)] cAch ; 
arin =- i5 according to (12). 


When T < eT” + (1 — e)TR"t, ie, TR"! > 
Problem (13) becomes 


Mie. = 





TTi" 
l-e ?’ 

















Ac Ch pin * in ou 
ne ase Tiga + BEH hta Chr TD) AA 
st, Ti” + (L— Te < TM, <T. 


The optimal solution of (14) depends on the value 


of EH ya (Tiha; Ch+1, TRX) 





aT, , which is non-decreasing 
according to Lemma 1. For clear and concise, we 
OE[H. THe ona, Tee 
dénote SEIMies Tha iones THE) . and 
h+1 elep leo 


OE[HF 1 (Tatas chqiTri i) 


in 
aT 





_ by Hý and H3, respectively. 
T 


olf HE + gfty < 0, Tin iue Tiol + 
always negative. The optimal solution and optimal 
value of (14) are T/", = T and M(T}", ca, Te“) = 
AT + BEH (T; ch41, TR) respectively. 
As M(T}”,cn,TR"*) is independent of T}”, 
OHRT sch Tee) _ 
oT” n(l—e)* 
. If Hi + gees > 0, i.e., Cn > 
Thi = eT$” + (1— e)T?”*. According to (12), we have 
Hy, (Ty, h op, Toe) = £6 THF, 4 ( Thai cnr, Tey’). 
OH} (Ti cn, Tee’) 














is 

















Acne 





2n- oMi = cı, then 
































EH} (T$ T, 
Thus, Bre = B [ ni itt parse) — 
GH. 
e IHI < -mi e 5S H3, then the optimal T;'}; satisfies 
ə Hip (Tia Ch+1, Tri) Ach : 
arin Bull) ° As the optimal 


h+1 


Tj", is independent of Tj”, M(T}”, cn, TR“*) is also 

















: in OHA (TE ch TR) _ _ Acne 
independent of T7,". Hence, ere = ae) 
With the above analysis, we conclude that 
out TT" a [He (TE sen, Te*)] eAch 
e When Th < Ie >’ arin = n(—e)* 


Ach 














t eT" 
e When Tp” a ah and Hi a Bn < 0 (Ch í c1), 
OHY (T; ch, TP" 
ore o gni, 
t Tere Ac 
e When Ty" > oe and Hi + ma > 0 (cnr > &), 
OHY (TR Ch TR) _ _ Acne 
aT” n(1—e)* 


Combine with the boundaries of To and cp, we have 





PEH] (TH; Cn, TR“) 


oT” 
Tout 
out out 
=f, F a5 f(og(Te™ )dcedT 


mout 
Ace 


Ea Tout dcd T°“ 
ew fo Haye) 
T Z 
+ BH; f(c)g(T°™" )dedT 
Tout C1 
Ajlc€ 
n(1 — e) 


TA ag 
+ f / [Hi + 
Pout Et 
Ape 
n-e 
A - 7 out out 
Pore (ce — c1) f(e)g(T™*) ded T™, 


n(1 = €) Tout. Cl 











out 





(15) 


Ace 


aeg f(e)g(Po™ ded T°" 


mout 


Zeri pre 


out — 
where TS” = [>] Tout: 














APPENDIX D 
PROOF OF PROPOSITION 2 


Proof. 
Hj, (Eni ch) = 
min Chph + BEH} 1(Eh+1; Ch411 )] 
h 


s.t. (le) — (1g). 


AE[HE(Enicn)] : ned 
We prove ——"oE, 1S a non-increasing and piecewise 


constant function by mathematical induction initiating from 

the last time slot. In the mathematical induction, we also 
: : . . OE[H; (Enscn)] 

provide an iteration step to derive ——37~—~. 














(16) 


When + is the last time slot, i.e., h = n, the future cost will 
not be considered, i.e., E[H}44(En+1;¢n)] = 0. Then, the 
optimal solution for optimization (16) is p% = ņ2 min|En, pl, 
i.e., the storage will run maximum discharge regardless of 
the amount of remaining storage and the price. Hence, 
the operating cost of the energy storage is H*(Enjcn) = 
—N2Cn min[E,,, p|. Moreover, 























En € [0,3] 
otherwise 





DELH; (Eni cn)] _ P a7) 
0, ' 


OE», 


which is a non-decreasing piecewise constant function. 





dE[H} 1 (En+1;cn+1)] 

ae 
B dE[H} 1 (En+41; en+1)] 

Cm dm è 


— -fm 














The illustration of 


Ph 
JE[H* (Enya; : ; 
Assume that a is a non-decreasing piece- 


wise constant function with respect to Ep; 41 with 2A; + 1 


Fig. 1. Pepa Ensch), 














pieces, with c} > ch > -+ Chypr: 
OEn+1 
=c), Ena. € [E°, E} 
= —c}, Ep41 E€ [E}, E?] 
= Chy? Enzi € [E2>2, E2>2+1] 


where EE = |$ |p + (€ — 2[§])Ao, VE € [0, 2A: + 1]. 
Let (pn, En; ch) denote the objective in (16). The sub- 
derivative of Ç(pn, En; Cn) is 












































OC (Ph, En; Ch) = a? OTH ay (Fn4i3 cn41)) 
Opn apn (19) 
zo d ane [Hipi (Enti; ch) 
OFn41 
waere q= fo mar 
1/n2, Pn <0 
When En € [E&, E+], p Eha Eni ide 


scribed as the black line in Fig. 1. According to Fig. 1, the 














charging/discharging decision at time h with Ep € [ES, BSH 

is 
e Case 1: If 
OEH _(En+1; Ch 
cn + onli Patri C41) <0, (20) 
Oph Pr=0 
i.e., Ch < mce, then pý, > 0. 
- If ch < Bmceso, Dp = T The operat- 


ing cost of the energy storage is H% (Enr; ch) = 





























7 + BE[H;,. (En +B; cn41)]. The subderivative is 
IHi (Enrich) _ 
OEn = — Beg+2. 

- If Bmceso < Ch < bM, Ph = 
1/n,(ES*? — E),). The operating cost of the en- 
ergy storage is H*(En;cn) = cn/m(ESt? — 
En) + BE[H},, (ES*?; cn41)]. The subderivative is 
OH} (En; Ch) _ -2 

"Er 

- If Bnicez1 < cn 2 Bmce, pe = 1/m(ES*! — Ep). 

The operating cost of the energy storage 


is Hi(Enich) =  cr/m(ESt* — Ep) + 





The — subderivative is 








p [Hi (ES? ; Cn41)]. 
OH Enica) _ — Sh, 
e Case 2: If Brice = Ch < B/nace, pj, = 0. The 


operating cost of the energy storage is Ht (Bs cn) = 





























BE|H; (En; cn+1)]. The subderivative is aus 
—Bce_1. 
e Case 3: If 
OEH  (En41;C 
asg [Hi1 (Enr+1; Ch+1)] sO o) 


pn Pnr=0 
` Bce * 
Le€., Ch > TS, then p% < 0. 


- f fS < en < “=, ph = m(BS — En). The 
operating cost of the energy storage is Hj, (En; cn) = 

















nocn(ES — En) + BE[H;,,,(E%;cn41)]- The sub- 
derivative is P iiie = —N2Chp. 
— If f < cp < F, ph = m( E-I — Ep). The 





operating cost of the Pa storage is a x (En; ch) = 

















ncn (EST 1 — En) + B LH} (E871 ;Ch41)l. The 
subderivative is Oe en) = —N2Ch. 
- É c > R = 2, Pp, = —mp. The operat- 


ing cost of the energy storage is H}(En;cn) = 














—nocnp + BE[H; 4 (En — D; n41)]. The subderiva- 
tive is CHa (Enicn) — — ße 

OE; a €—2- 
dE[H* (Enscn)l 


Hence, E, is a non-decreasing and stepwise con- 
stant function. Moreover, PE Ecl with En € [E§, ES*7] 
can be derived by 
JE[H;, (Eni cn) 

OE}, 

















zZ Pega 
me f Bceg_of (e jäe- fra mcf(c)de 
ct K (22) 
Be Pmce e 
- |” paatide- f © Erode 
Bnice Bnicez2 M1 


NLCE+2 
— [Beers floae 














